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We extend earlier work of the same author to enumerate alternat- 
ing permutations avoiding the permutation pattern 2143. We use a 
generating tree approach to construct a recursive bijection between 



\jQ I the set A2n(2143) of alternating permutations of length 2n avoiding 

■^ ■ 2143 and standard Young tableaux of shape (n, n, n) and between the 

zi ! set ^2^+1 (2143) of alternating permutations of length 2n + 1 avoiding 

• \ 2143 and shifted standard Young tableaux of shape (n + 2, n + 1, re). 

Q ■ We also give a number of conjectures and open questions on pattern 

^D . avoidance in alternating permutations and generalizations thereof. 



1 Introduction 

In [5], the author enumerated the set 742„(1234) of alternating permutations 
with no four-term increasing subsequence by showing that it is in bijection 
with the set of standard Young tableaux of shape (11,12,71). One of the two 
proofs given of this result may be understood as a demonstration that these 
permutations and tableaux have isomorphic generating trees, that is, that 
they have the same recursive structure. (The other proof used a modification 
of the RSK correspondence first used by Ouchterlony [6] in the context of 
doubly-alternating permutations.) In this paper, we show that this approach 
can be extended to enumerate alternating permutations avoiding the pattern 



2143. In particular, we show that y42„(2143) is in bijection with standard 
Young tableaux of shape {n,n,n) (and so also with yl2„(1234)) and that 
^2^+1 (2143) is in bijection with shifted standard Young tableaux of shape 
{n + 2,n+ l,n). We end with a large number of open problems. 

In Section [2l we provide some definitions and notation that will be used 
throughout the paper. In Section [31 we describe a generating tree for stan- 
dard Young tableaux of certain shapes and show that it obeys a simple two- 
parameter labeling scheme. In Section HTTl we briefly review (without proof) 
one of the main results of [5j, namely that alternating permutations of even 
length with no four-term increasing subsequence share the same generating 
tree as the tableaux of Section [31 In Section [121 we show that alternating per- 
mutations of even length avoiding the pattern 2143 also share this generating 
tree. In Section [5l we show that similar methods can be used to enumerate 
alternating permutations of odd length avoiding the pattern 2143, and that 
the resulting bijection is with shifted Young tableaux of certain shapes. In 
Section [6l we give several conjectures and open problems relating to pattern 
avoidance in alternating permutations. In Section [7] we provide data that 
forms the basis for several of these conjectures. 

2 Preliminaries 

In this section, we provide important definitions and notation that will be 
used throughout the rest of the paper. 

2.1 Permutations, partitions, tableaux 

A permutation w of length n is a word containing each of the elements of 
[n] := {l,2,...,n} exactly once. The set of permutations of length n is 
denoted Sn- Given a word w = wi- ■ ■ Wn and a permutation p = pi ■ ■ ■ Pk G 
Sk, we say that w contains the pattern p if there exists a set of indices 
1 < ii < i2 < . . . < ik < n such that the subsequence Wi^Wi^ ■ ■ -Wi^ of w 
is order-isomorphic to p, i.e., such that Wi^ < Wi^ if and only ii pi < p^- 
Otherwise, w avoids p. Given a pattern p and a set S of permutations, we 
denote by S{jp) the set of elements of S that avoid p. For example, S'„(123) 
is the set of permutations of length n avoiding the pattern 123, i.e., the set 
of permutations with no three-term increasing subsequence. We denote the 
size of a set S by \S\, so |S'3(123)| = 5. 



A permutation w = W1W2 ■ ■ -Wn is alternating ii Wi < W2 > w^ < . . .. 
(Note that in the terminology of |9j, these "up-down" permutations are re- 
verse alternating while alternating permutations are "down-up" permuta- 
tions. Luckily, this convention doesn't matter: any pattern result on either 
set can be translated into a result on the other via complementation, i.e., by 
considering w'^ such that w1 = n + 1 — Wi. Then results for the pattern 123 
and up-down permutations are replaced by results for 321 and down- up per- 
mutations, and so on.) We denote by An the set of alternating permutations 
of length n. 

A partition is a weakly decreasing, finite sequence of nonnegative integers. 
We consider two partitions that differ only in the number of trailing zeroes 
to be the same. We write partitions in sequence notation, as (Ai, A2, . . . , A„). 

Given a partition A = (Ai, A2, . . . , A„), the Young diagram of shape A is 
the left-justified array of Ai + . . . + A„ boxes with Ai in the first row, A2 
in the second row, and so on. We identify each partition with its Young 
diagram and speak of them interchangeably. If A is a Young diagram with 
m boxes, a standard Young tableau of shape A is a filling of the boxes of A 
with [m] so that each element appears in exactly one box and entries increase 
along rows and columns. We identify boxes in Young diagrams and tableaux 
using matrix coordinates, so the box in the first row and second column is 
numbered (1,2). We denote by SYT(A) the set of standard Young tableaux 
of shape A. 

2.2 Generating trees 

Given a sequence {S„}„>i of nonempty sets with |Si| = 1, a generating tree 
for this sequence is a rooted, labeled tree such that the vertices at level n 
are the elements of S„ and the label of each vertex determines the multiset 
of labels of its children. In other words, a generating tree is one particular 
type of recursive structure in which heredity is determined by some local 
data. We are particularly interested in generating trees for which the labels 
are (much) simpler than the objects they are labeling. In this case, we may 
easily describe a generating tree by giving the label Li of the root vertex (the 
element of Si) and the succession rule L \-^ S that gives the set S of labels 
of the children in terms of the label L of the parent. 

Beginning with work of Chung, Graham, Hoggatt, and Kleiman j2], gen- 
erating trees have been put to good use in the study of pattern-avoiding 
permutations, notably in the work of West (see, e.g., [HI [12] )• The usual 



approach has been to consider subtrees of the tree of all permutations given 
by the rule that v G S'„+i is a child of m G S'„ exactly when erasing the 
entry n + 1 from v leaves the word u. Because we are interested here in 
alternating permutations and the permutation that results from erasing the 
largest entry of an alternating permutation typically is not alternating, this 
tree is unsatisfactory. However, the inverse tree, in which we arrive at the 
children of u by inserting arbitrary values in the last position (rather than 
inserting the largest value in an arbitrary position), is well-suited to the case 
of alternating permutations. This motivates the following definitions. 

Given a permutation u G Sn and an element i G [n + 1] , there is a unique 
permutation v = f if 2 ■ ■ ■ VnVn+i G Sn+i such that Vn+i = i and the word 
'yi'y2 ■ ■ -Vn is order-isomorphic to u. We denote this permutation hj u ^ i 
and refer to it as the extension of m by z. In other words, the operation of 
extending u hj i replaces each entry c>iinMbyc+l and then attaches i 
to the end of the result. For example, 3142 ^ 3 = 41523. 

Given a pattern p and a permutation w G 5'„(p), we say that c E [n + 1] 
is active or an active value for w (with respect to p) ii w -^ c avoids pu 

There is a natural generating tree structure on alternating permutations 
of even length analogous to the tree on all permutations mentioned above: 
given an alternating permutation u of length 2n, its children are precisely 
the alternating permutations v of length 2n + 2 such that the prefix of v of 
length 2n is order-isomorphic to m. (Of course, there is also a similar tree 
for alternating permutations of odd length.) Since pattern containment is 
transitive, the set IJn>i^2n(p) of alternating permutations of even length 
avoiding the pattern p is the set of vertices of a subtree. It is these trees (for 
the patterns 1234 and 2143) that we will consider in Section HJ 

3 A generating tree for tableaux 

For n > 1, the collection of standard Young tableaux of shape {n,n,n) has 
a simple associated generating tree: given a tableau 5* G SYT{n,n,n), its 
children are precisely the tableaux T G SYT(?7. -|-l,n+l,n + l) such that 
removing the last column of T leaves a tableau that is order-isomorphic to 5*. 
Notice that the shape of the tree below S is determined entirely by the entries 



^ This terminology is borrowed from the "usual" case, in which a position is said to 
be active (or is called an "active site" ) if one can insert n + 1 into that position while 
preserving pattern avoidance. 



of the last column of 5*, and in particular by the entries S{l,n) and S{2,n) 
(since S{3,n) = 3n for all S G SYT(n, n,n)). Thus, we wish to choose 
a labeling for our tree that captures exactly this information. Our choice 
(one of several reasonable options) is to assign to each S G SYT(n, n,n) the 
label (a, b) = {3n + 1 — 5(2, n),3n + 1 — S{1, n)). This provides a two-label 
generating tree for 

y SYT(n, n,n), 

n>l 

whose root (the unique standard Young tableau of shape (1, 1, 1)) has label 
(4 — 2,4—1) = (2,3). In Proposition 4.7 of [5j, the author established (in 
a more general context, and using an object called "good tableaux" rather 
than the equivalent generating tree we've defined here) the following result. 

Proposition 3.1. The generating tree that we have just described for stan- 
dard Young tableaux with all columns of length three obeys the rule 

{a,b) ^ {{x,y) \ 2 < X < a + I and x + l<y <b + 2}. 



For example, the root tableau 
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has label (2, 3) and has five children. 



and 



which have labels (2,3), (2,4), (2,5), (3,4) and (3,5), respectively. We re- 
state the proof of this result in our current language. 

Proof. Choose a standard Young tableau S G SYT(n, n, n) with label (a, &) 
and a child T G SYT(r2 + 1, n + 1, n + 1) of 5 with label (x, y). We wish to 
show that 2 < X < a + 1 and x + 1 <y <b + 2. Expressing these conditions 
in terms of the entries of S and T, we must show 



5(2, n) + 2< T(2, n + l)<3n + 2 



(1) 



and 



5(1, n) + l< T(l, n + l)< T(2, n + l)-l. (2) 

We first demonstrate that Equation [2] is valid. It follows from the rela- 
tionship between S and T that 5(1, n) < T(l, ra), and since T is a standard 



Young tableau we have ^(l,n) + l <T(l,n) + l <r(l,n+l) < T{2,n+1)-1, 
as needed. 

Now we demonstrate that Equation [1] is vahd. Since T is a standard 
Young tableau, we have T(2,n + 1) <T(3,n+l) = 3n + 3. ThusT(2,n+l) < 
3n + 2, which is the right half of the desired inequality. For the left half, we 
compute that 



T(2,n+1)= {(z,j)|r(z,j)<r(2,n + l)} 

> \{{i,j) I Tit,j) < T(2,n) and j < n} U {(2,n), (l,n + 1)} 

{{z,j)\S{z,j)<S{2,n)}U{{2,n),{l,n + l)} 
S{2,n) + 2, 



as desired. 

We've now established that Equations [1] and [2] hold for all children T of 
S, and so that the labels of the children of S satisfy the claimed inequalities. 
Now we must show that S has exactly one child with each of these labels. 

Given a parent tableau S and prescribed values T(l, n + 1) and T(2, n + 1) 
satisfying Equations [2] and [H we construct the tableau T in the only way 
possible: define T(3, n + 1) = 3n + 3 and for 1 < i < 3 and 1 < j < n, set 

'S{z,j), S{z,j)<T{l,n + l), 

Tihj) = { S{i,j) + 1, r(l,n + 1) < S{z,j) < T(2,n + 1), 
_S{z,j) + 2, T{2,n + l)<Siz,j). 

By construction, the object T that results is of shape {n + l,n + l,n + 1) 
and contains each of the elements of [3n + 3] exactly once. It is not difficult 
to check that Equations [1] and [2] imply that T is increasing along rows and 
columns and consequently that T G SYT(n +1, n + 1, n + 1), and also that 
T is a child of S. Thus, S has at least one child with each label satisfying 
the given conditions. Finally, it's clear that this T is unique. D 

4 Generating trees for ^2^(1234) and ^2^(2143) 

Recall from Section 12.21 that for any pattern p, there is a natural generating 
tree for the set IJn^2n(p) of p-avoiding alternating permutations of even 
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length: given a p-avoiding alternating permutation u of length 2n, its children 
are precisely the p-avoiding alternating permutations v of length 2n + 2 such 
that the prefix of v of length 2n is order-isomorphic to u. In this section, we 
study this tree for the patterns p = 1234 and p = 2143. 

4.1 1234 

One of the main results of [5j was that even-length alternating permutations 
with no four-term increasing subsequence share the generating tree for Young 
tableaux described in Section [31 We now briefly describe this labeling. 

Given a 1234-avoiding alternating permutation w, assign to it a label 
(a, b) where a is the smallest entry in w that is the largest entry in a two- 
term increasing subsequence of w, i.e., 

a = m.m{wj \ 3i < j s.t. Wi < Wj}, 

and b is the number of active values for w with respect to 1234, i.e., b is 
the number of choices of c G [2n + 1] such that if <— c is 1234-avoiding. 
(Equivalently, we could define b to be the smallest entry in w that the largest 
term in a three-term increasing subsequence, or b = 2n + 1 ii w contains no 
three-term increasing subsequence.) This labeling has previously been used 
(e.g., by West [IT] and Bousquet-Melou pQ) in the study of 5'„(1234). 

For example, we have for the permutation w = 27583614 G ^§(1234) that 
{wj \ 3i < j s.t. Wi < Wj} = {3, 4, 5, 6, 7, 8} and that the set of active values 
for w is {1, 2, 3, 4}. Thus a = 3 and 6 = 4. 

As a second example, we have for the permutation w = 68372514 G 
^§(1234) that {wj \ 3i < j s.t. Wi < Wj} = {4,5,7,8} and that w contains 
no three-term increasing subsequence so all of [9] is active for w. Thus a = A 
and 6 = 9. 

The root of this tree is the permutation 12 G ^42(1234), with label (2, 3). 
Propositions 4.3, 4.4 and 4.6 of [S] collectively establish that if w G y42n(1234) 
has label (a, b) then the collection of labels of children of w is exactly the set 
of (x, y) such that 2 < x < a-\-l and x + 1 <y <b + 2, each pair occurring 
with multiplicity one. 

We now turn our attention to the pattern 2143. 



4.2 2143 

In this section, we show that alternating permutations of even length avoid- 
ing 2143 have a generating tree isomorphic to those mentioned in preceding 
sections. 

Given a permutation w G y42n(2143), assign to it a label (a, 6) where 
(^ = W2n-i is the next-to-last entry of w and b is the number of active values 
for w in [2n + 1] . 

For example, the permutation w = 68143527 G yl8(2143) has active values 
{1, 2, 3, 8, 9} (the permutations 792546381, 791546382, 791546283, 691435278 
and 681435279 avoid 2143 while the permutations 691435287, 791435286, 
791436285 and 791536284 contain it). Thus a = 2 and 6 = 5. 

As a second example, the permutation w = 35462718 G ^8(2143) has 
active values {1, 2, 9}. Thus a = 1 and 6 = 3. 

We have that the root 12 G ^2(2143) has label (1, 3). We will show that 
under this labeling the generating tree for |J^ 742„(2143) obeys the rule 

{a,b) i^ {{x,y) \ 1 < X < a + 1 and X + 2 < y < b + 2}, 

and we will use this result to establish an isomorphism between this gener- 
ating tree and those discussed in the preceding sections. We break the proof 
of this result into several smaller pieces: Propositions 14.31 and 14.51 form the 
meat of the argument establishing the succession rule, while Propositions 14.21 
and 14.41 are helpful technical lemmas. We begin with a simple observation 
that will be of use in the subsequent proofs. 

Observation 4.1. Given a permutation w G S'„(2143), we have that c G 
[n + 1] is not active for w if and only if there exists i < j < k such that 

Wj < Wi < C < Wk- 

Proposition 4.2. If u E y42„(2143) and U2n-i = a then {1, 2, . . . , a -|- 1} are 
active values for u. 

Proof. Fix u G ^2^(2143) with U2n~i = o, choose c < a + 1 and let v = 
u -^ c E S2n+i- We wish to show that v avoids 2143, so suppose otherwise. 
Then there exist i < j < k < 2n + 1 such that ViVjVkC is an instance of 
2143 in V. We use this (suppositional) instance to construct an instance of 
2143 in u] this contradiction establishes that c is active for u. In particular, 
we show that UiUjU2n-2U2n-i is an instance of 2143 in u by showing that 
ViVjV2n-2V2n-i is an instance of 2143 in v. In order to do this, it suffices to 
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show that J < 2n — 2 (so that ViVjV2n~2V2n-i is a subsequence of v) and that 
Vi < V2n~i (so that this subsequence is order-isomorphic to 2143). 

Since ViVjVkC is an instance of 2143 and c < a + 1, we have that Vj < 
Vi < c < a + 1 and thus Vi < a = ■U2n-i < V2n-i- There are at least three 
entries to the right of Vi in v but only two to the right of f 2n-i, so Vi ^ f 2n-i 
and actually f j < f2n-i, one of the two conditions we need. It follows that 
Vj < Vi < V2n-i < V2n-2 and similarly Vj < V2n, so Vj is smaller than all 
of V2n-2,V2n-i,V2n and V2n+i- Thcse entries form a suffix of v, so Vj must 
occur at an earlier position in v. That is, we have j < 2n — 2, the second 
necessary condition. Thus ViVjV2n-2V2n-~i is an instance of 2143 in v and so 
UiUjU2n-2U2n-i is an instance of 2143 in u. Since u avoids 2143, this is a 
contradiction, so actually v avoids 2143 and c is active for -u, as desired. D 

Proposition 4.3. If u G A2„(2143) has label {a,b) andw is a child of u with 
label (x, y) then 1 < x < a + 1 and x + 2 < y <b + 2. 

Proof. Suppose that permutations u G A2n and w G A2n+2 have the property 
that the first 2n entries of w are order-isomorphic to -u, and set a = U2n-i- 
If W2n+i > a + 1 then also W2n > a + 1 and W2n+2 > a + 1, while W2n-i = o- 
Thus w~^{a + 1) ^ {2n — 1, 2n, 2n+ 1, 2n + 2} and so defining i = w~^{a+ 1) 
we have i < 2n — 1. Then WiW2n-iW2nW2n+i is an instance of 2143 in w. 
Taking the contrapositive, if w avoids 2143 then W2n+i < a + 1. Now fix 
u G A2„(2143) with label (a, 6) and a child w G A2n+2(2143) of u with label 
{x,y); the preceding argument shows that x < a + 1. Clearly a; > 1, so we 
have proved the first half of our assertion. We now proceed to bound y, the 
number of active values of w. 

Define a one-to-one function / : [2n] — )■ [2n + 2] by 

Z, Z < W2n+1 

f{z) = ^z + 1, W2n+1 <Z< W2n+2 
Z + 2, W2n+2<Z, 

SO f{ui) = We for all i G [2n]. We show that / is a map from nonactive 
values of u to nonactive values oi w. To this end, choose any c G [2n] that 
is not active for u, and choose i < j < k such that Uj < Ui < c < Uk- 
We have {wi,Wj,Wk, f{c)) = {f{ui)J{uj)J{uk)J{c)). One can easily see 
that / preserves order, so Wj < Wi < f{c) < Wk and thus /(c) is not active 
for w. Thus for each of the 2n — b choices of a nonactive value c for u 



we have a corresponding nonactive value /(c) for w and so w has at most 
(2n + 2) — {2n — 6) = 6 + 2 active values, i.e., y < b + 2. 

Finally, we have by Proposition 14. 21 that {1, 2, . . . , a; + 1} are active values 
for w. We also have that 2r2 + 3 is active for w and that 2n + 3 ^ {1, 2, . . . ,x-\- 
1}, so there are at least x + 2 active values for w. Thus x + 2 < y, which 
completes the proof of our claim. D 

Proposition 4.4. Suppose u G y42n(2143) has label {a,b) and active values 
Si < S2 < . . . < Sh- If X < a + 1 and v = u -k- x then v G y42n+i(2143) and v 
has active values 1, 2, . . . ,a;, s^, + 1, s^+i + 1, . . . , st + 1. 

For example, u = 68143527 e ^§(2143) has label (2,5) and active values 
1, 2, 3, 8 and 9. For a; = 3<2 + lwe have v = 791546283 with active values 
1, 2, 3, 4 (= 3 + 1), 9 (= 8 + 1) and 10 (= 9 + 1). 

Proof. Choose u G y42„(1234) with label {a,b) and choose x < a + 1. Let 
si < . . . < Sf, be the active values for u and let f = m <— x. Since V2n+i = 
X < a + 1 < f2n-i + 1 and f2n-i < V2n, we have V2n+i < V2n and thus 
actually f2n+i < W2n- Thus v is alternating. Also, by Proposition 14.21 x 
is an active value for u and so v avoids 2143. This proves the first part 
of our claim, and we now must show that the set of active values for v is 
{1,2, . . . ,x,Sx + I, Sx+i + 1, . . . , Sfc + 1}. We first show that each of these 
values is in fact an active value for v. 

Case 1. Fix m > x so that s^ > x is an active value for u. We wish to 
show that Sm + 1 is an active value for v. Let w = wi- ■ ■ W2n+2 be the 
result of extending f by s^ + 1, and suppose for sake of contradiction 
that w contains an instance WiWjWkWi of 2143. Since v avoids 2143, we 
must have i = 2n + 2, so we = W2n+2 = Sm + 1- As W2n+2 = s^ + 1 > 
X = V2n+i, extending t> by s^ + 1 does not change the value of the 
(2n + l)th entry and thus W2n+i = V2n+i = x, whence W2n+2 > 'U^2n+i- 
Since Wk > W2n+2, we have k ^ 2n + 1 and so W2n+i is not part 
of our instance of 2143. Let v' be the permutation order-isomorphic 
to W1W2 ■ ■ ■ W2nU!2n+2- Thus vlv'jV'i^V2n+i is an iustauce of 2143 in v'. 
However, we also have that v' = u -^ Sm and that Sm is active for u. 
This is a contradiction, so w cannot contain an instance of 2143, and 
we conclude that Sm + 1 is an active value for v by definition. 

Case 2. Fix c < a; so that c = Sc is an active value for u. We wish to 
show that c is an active value for v. Let w = Wi- ■ ■ W2n+i'UJ2n+2 be the 
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result of extending v by c, and suppose for sake of contradiction that w 
contains an instance WiWjWkWc of 2143. If {k, £} ^ {2n + l, 2n + 2} then 
we can conclude by an argument nearly identical to the previous case, 
so assume that k = 2n + l and i = 2n + 2. Since Wi < Wk = W2n+i and 

Wj < Wk = W2n+1 but W2n > W2n+1, ^U ^ {i,j} and so WiWjW2nW2n+2 

is another instance of 2143 in w. But now we have an instance not 
including W2n+i and so we may proceed as in the previous case. We 
conclude that c is an active value for v. 

Finally, we show that these values are the only active values for v. In 
particular, we must show that for every c > x that is not active for u, c+ 1 
is not active for v. Fix such a c. Since c is not active for u, there exist 
i < j < k such that Uj < Ui < c < Uk- We have ve < ue + l for all i G [2n], so 
Vj < f j < c + 1. Since m^ > c — 1 > x, we have Vk = Uk + I- Thus Vj < Vj < 
c+l<Uk + l = Vk and so c + 1 is not an active value for v. We conclude 
that the active values for v are exactly 1,2, . . . ,x,Sx + l, s^+i + 1, . . . , s^ + 1, 
as claimed. D 

Proposition 4.5. // m G y42„(2143) has label {a, b) and 1 < x < a + 1, 
x + 2<y<b + 2, then there is a unique child w G yl2„+2(2143) of u with 
label (x, y). 

Proof. Choose a permutation u G 742„(2143) with label {a,b) and choose 
{x, y) such that 1 < x < a + 1 and x + 2<y<b + 2. We will construct a 
child of u with label {x,y). 

Let Si < . . . < Sb he the active values for u. Define v = f 1^2 ■ ■ ■ t>2„f2n+i 

and W = W1W2 ■ ■ ■ W2nW2n+lW2n+2 hj V = U <^ X and W = V -^ {Sb+2+x-y + 1)- 

We claim that w is the desired permutation. We must show that w belongs 
to ^2^+2(2143) and that its label really is {x,y). 

It follows from Proposition 14.41 that v G A2„+i(2143). Because y < b + 2, 
we have b + 2 + x — y>x and so Sb+2+x-y + 1 > s^. = x = f2n+i- Thus w is 
alternating. We also have from Proposition 14.41 that Sb+2+x~y + 1 is an active 
value for v, so w E A2„4.2(2143). We have left to show that w has label (x, y). 

Since W2n+2 > '^2n+i, extending v by W2n+2 leaves the value of the entry in 
the (2ra + l)th position unchanged and so W2n+i = W2n+i = x. It remains to 
show that w has exactly y active values. We claim that the active values for w 
are precisely l<2<...<x + l< Sb-f-2+x-y + '^ < Sb+3+x-y + '^ < . . . < Sb + 2. 
By Proposition 14.21 we already know that 1, 2, . . . , x + 1 are active for w. 
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For any fixed i such that b + 2 + x — y < i < b, let z = w ^ {si + 2) . 
We wish to show that z avoids 2143. We proceed by the same argument 
as in Case 1 of the proof of Proposition 14.41 since s, + 2 > W2n+2, we have 
Z2n+2 = W2n+2 < Z2n+3- It follows that Z2n+2 and Z2n+3 cauuot bc part of the 
same 2143 pattern in z. Thus z contains an instance of 2143 if and only if 
z' = zi- ■ ■ Z2n+iZ2n+3 does. Howcver, z' is order-isomorphic to f <— (sj + 1). 
Since Sj + 1 is an active value for v, z' avoids 2143 and so z avoids 2143. Thus 
Sj + 2 is an active value for w. There are b— {b + 2 + x — y) + l = y — x — 1 
such active values. We must show that there are no other active values for 
w larger than x + 1. 

For any fixed c > Sb^2+x~y + 2 that is not of the form s, + 2, we wish to 
show that w -(— c contains 2143. We proceed by the same arguments that 
follow Case 2 of the proof of Proposition 14. 4t if ViVjVk are entries of v that 
can be used to form a 2143 pattern when v is extended by c— 1 then WiWjWk 
can be used to form a 2143 pattern when w is extended by c. 

Finally, for any fixed c such that x + 1 < c < Sb+2+x-y + 2,let z = w ^ c. 
We wish to show that z contains 2143. We have that Z2n+i = x, Z2n+2 = 
Sb+2+x-y + 2 > c, and Z2n+3 = c> X + 1, and we know that there exists i < 
2n + l such that Zi = x+l. Then ZiZ2n+iZ2n+2Z2n+3 = (x + l)x{sb+2+x-y + 2)c 
is an instance of 2143 in z, so c is not active for w. 

The preceding four paragraphs account for all elements [2n + 3]. We've 
shown that exactly {x + 1) + {y — x — 1) = y oi these values are active for w. 
Putting everything together, we have that w G y42„+2(2143) is a child of u 
with y active values and W2n+i = x, i.e., w has label {x, y). In fact, it follows 
from our proof that every child of u has a distinct label: we've exhausted 
the possible pairs of values for W2n+i, W2n+2 such that w G yl2„+2(2143) is a 
child of M. n 

Theorem 4.6. For all n > 1 we have 

2 ■ {3n)\ 



|A2„(2143)| = |SYT(n,n,n)| = |A2„(1234)| 



n\{n + l)\{n + 2)\' 

Proof. Proposition 13.11 shows that the generating tree for |J„>]^ SYT(n, n, n) 
has root (2, 3) and rule 

{a,b) h^ {{x,y) \ 2 < X < a + 1 and X + 1 < y < b + 2} 

while Propositions 14.31 and 14.51 together show that the generating tree for 
Un>i ^2n(2143) has root (1,3) and rule 

(a, 6) H-> {(x, y) I 1 < a; < a + 1 and x + 2<y<b + 2}. 
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These two trees are isomorphic: replacing each label (a, b) in the first tree 
with (a — 1, b) results in the second tree. Thus, there is a recursive bijection 
between 742n(2143) and SYT(?T,,n, n), and we have the first claimed equality. 
The work in [5j summarized in Section HTT] gives the second equality. Finally, 
applying the hook-length formula (see, e.g., [10, Chapter 7.21]) gives the 
third equality. D 

5 Generating tree for A2n+i(2143) 

Turning out attention to alternating permutations of odd length, we find 
that the generating trees of 742„+i(1234) and 742„+i(2143) are not isomor- 
phic. Indeed, the two sequences enumerate differently: all sixteen alternating 
permutations of length five avoid 1234, but only twelve of them avoid 2143. 
Although this initially seems disappointing, it turns out that we can still use 
the methods of the preceding section to enumerate 2 143- avoiding alternating 
permutations of odd length. 

As in [5j, it is convenient to consider the set ^2n+i ^^ down-up alternating 
permutations of odd length rather than up-down alternating permutations; 
note that results in either case may be translated into results in the other 
via reverse-complementation. Arguments very similar to those of Section 14.21 
show that if we associate to the permutation w G v42„_,_]^(2143) the label (a, b), 
where a = W2n and b is the number of active values for w then the generating 
tree for [J^^^ A'2n^i{214:3) is as follows: 

Root: (0,2) 

Rule: {a,b) h^ {{x,y) \ 1 < a; < a + 1 and x + 2<y<b + 2} 

Here the root permutation 1 G y4'^(2143) has label (0,2). Its two children 
213,312 G ^3(2143) have labels (1,3) and (1,4), respectively, and so on. 

We seek to enumerate A2„_,_^(2143) by aping our approach for even-length 
permutations, i.e., by finding a family of objects with isomorphic generating 
tree that we already know how to enumerate. In the case at hand, these ob- 
jects turn out to be shifted standard Young tableaux (henceforward SHSYT) 
of shape {n + 2,n + l,n). (See [1] or [3l Chapter 10] for definitions, etc.) 

Given a SHSYT T of shape (n + 2, n + 1, n), assign to it the label (a, b), 
where a = 3n + 4 - T{n + 2, 2) and 6 = 3n -F 4 - T{n + 2, 1). (Note that for 
77, > 1, we have T{n + 2, 3) = 377, -|- 3 for every SHSYT of this shape, so this 
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label captures all the information we need to reconstruct the last column of 

I 1 1 2 I 
T.) Then the root of the tree is the unique SHSYT ' q- of shape (2, 1), 

which has label (1,2). Its children are the two SHSYT 



and 



of shape (3,2, 1), which have labels (2,3) and (2,4), respectively. In subse- 
quent layers of the tree, the succession rule is identical to the rule for rectan- 
gular tableaux; indeed, the subtree below an SHSYT of shape {n + 2,n + l,n) 
depends only on its last column (or equivalently, on its associated label), and 
so might as well be the subtree of an SYT of shape ((n + 1)^) with the same 
label. 

It follows immediately that |y42„_,_i(2143)| (and so also |yl2n+i(2143)|) is 
the number of SHSYT of shape (n + 2, n + 1, n). As in the case of standard 
Young tableaux, there is a simple hook-length formula for SHSYT (see e.g. 
[1] or [21 pp. 187-190]). In our case, it gives the following result. 



Proposition 5.1. For n > we have 



\A 



2n+l 



(2143)1 



2(3ri + 3)! 



n\{n + l)!(n + 2)\{2n + l){2n + 2)(2n + 3) ' 



6 Open problems 

In this section we pose a number of open enumerative problems related to 
pattern avoidance in alternating permutations. 

6.1 Other equivalences for patterns of length 4 

If permutations p and q satisfy |A2„(p)| = |A2„(g)| for all n > 1, we say that 
p and q are equivalent for even-length alternating permutations. Note that if 
p = Pi- ■ -Pk and q = {k + 1 — pk) {k + 1 ~ p^-i) ■ ■ ■ (k + l—pi) (i.e., p and q are 
reverse-complements) then p and q are equivalent for even-length alternating 
permutations: for every n, the operation of reverse-complementation is a 
bijection between A2n{p) and A2n{q)- Pairs of patterns that are equivalent 
for this reason are said to be trivially equivalent. Similarly, if |y42n+i(p)| = 
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l^2n+i(Q')l for ^11 n > 0, we say that p and q are equivalent for odd-length 
alternating permutations, and if p is the reverse of q then we say they are 
trivially equivalent. 

Numerical data (see Section [7]) suggest the following conjecture. 

Conjecture 6.1. We have \A2n{p)\ = |A2„(1234)| (= |A2„(2143)|) for all 
n>l and every p G {1243, 2134, 1432, 3214, 2341, 4123, 3421, 4312}. 

Observe that these eight patterns come in four pairs of trivially equiva- 
lent patterns. The results of West [11] and computer investigations of short 
permutations suggest that some of these equivalences may be susceptible to 
a generating-tree attack. In particular, the generating trees for alternating 
permutations avoiding 1243 or 2134 may be isomorphic to the generating 
tree discussed in Sections [3] and HI 

For alternating permutations of even length, the only other possible equiv- 
alences not ruled out by numerical data are captured by the following con- 
jecture. 

Conjecture 6.2. We have |A2„(3142)| = |A2„(3241)| = |A2„(4132)| and 
|A2„(2413)| = |A2„(1423)| = |A2„(2314)| for all n>l. 

In both cases, the second of the two equalities is a trivial equivalence. 
For odd-length alternating permutations, computational data suggest the 
following conjectures. 

Conjecture 6.3. We have \A2n+iip)\ = |^2n+i(1234)| for all n > and 
every p G {2134, 4312, 3214, 4123}. 

We also have the trivial equivalence |y42n+i(1234)| = |A2rt+i(4321)|. The 
equivalence between 4321 and 4312 may be amenable to generating tree meth- 
ods. 

Conjecture 6.4. We have \A2n+i{p)\ = |A2n+i(2143)| for all n > and 
every p G {1243, 3421, 1432, 2341}. 

We also have the trivial equivalence |y42n+i(2143)| = |y42n+i(3412)|. The 
equivalence between 3412 and 3421 may be amenable to generating tree meth- 
ods. 

The only other possible equivalence for odd-length alternating permuta- 
tions not ruled out by data is captured by the following conjecture. 
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Conjecture 6.5. The permutations 2314,4132,2413,3142,1423 and 3241 
are equivalent for odd-length alternating permutations. 

Other than the cases covered by Conjectures 16.1^ 16.31 and 16.41 none of 
the sequences {|A2n(p)|}n or {|A2n+i(p)|}n for p G 5*4 are recognizable to 
the present author (and in particular they do not appear in the OEIS [7]). 
Numerical data (see Section [7]) rule out simple product formulas similar to 
those of Theorem 14.61 and Proposition 15.11 However, in some cases it may be 
possible to give a generating tree and so perhaps to adapt the method of pQ 
to find generating functions or even closed formulas. 

6.2 Other problems 

The conjectures of the preceding section concern two equivalence relations on 
patterns of length four: equivalence for even-length alternating permutations 
and equivalence for odd-length alternating permutations. It happens that 
these relations are both refinements of the usual (Wilf-)equivalence relation 
for all permutations (see, for example, [8]). (Note that this is true on account 
of numerical data, regardless of the truth of any of the preceding conjectures.) 
This suggests the following conjecture. 

Conjecture 6.6. If permutations p and q are equivalent for alternating per- 
mutations of either parity then p and q are Wilf- equivalent for all permuta- 
tions. 

More broadly, we can ask the following question. 

Question 6.7. Are there any large families of patterns that can be shown to 
be equivalent for alternating permutations (of either parity) ? 

The work in [5] suggests two possible generalizations of alternating per- 
mutations for purposes of pattern avoidance. One of these (denoted £„ ^ in 
[S] ; it consists of the reading words of standard Young tableaux of the "thick- 
ened staircase" shape {n + k — l,n + k — 2, . . . ,k + l, k)/{n— l,n — 2, . . . , 1)) 
does not seem to give rise to nontrivial equivalences. However, an alternative 
(and perhaps more natural) generalization is the set Des^^fc of permutations 
of length n with descent set {k, 2k, . . .}. 

Question 6.8. Is Des„^fc a "good" context to study pattern avoidance? In 
particular, are there any pairs or families of patterns that can be shown to 
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be Wilf-equivalent for these permutations? Is Conjecture \6.6\ valid in this 
context? 

In analogy with the case of alternating permutations, it is natural to 
consider separate cases depending on the congruence class of n modulo k. 
Finally, we note that it may also be fruitful to consider permutations whose 
descent set is contained in (rather than "is equal to") {k, 2k, . . .}, a case on 
which our work here does not touch. 
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7 Appendix 

The tables of data that follow form the basis for several of the conjectures 
in the preceding section. They were generated by brute-force computer enu- 
meration. 

Tables [1] and |2] give the number of alternating permutations avoiding 
patterns of length four, grouped by conjectural equivalence. 



Patterns 


1 3 5 


7 9 11 


(1234,4321), (2134,4312), (3214,4123) 


1 2 16 


168 2112 30030 


(2143,3412), (1243,3421), (1432,2341) 


1 2 12 


110 1274 17136 


(2314,4132), (2413,3142), (1423,3241) 


1 2 12 


106 1138 13734 


(1324,4231) 


1 2 12 


110 1285 17653 


(1342,2431) 


1 2 12 


108 1202 15234 


(3124,4213) 


1 2 16 


168 2072 28298 



Table 1: Values of An{p) for odd n and p E S4. Parentheses indicate trivial 
equivalences. 



Patterns 


2 4 6 


8 


10 


12 


1234, (1243,2134), (1432,3214), 
2143, (2341,4123), (3421,4312) 


1 5 42 


462 


6006 


87516 


3142, (3241,4132) 


1 5 42 


444 


5337 


69657 


(1423,2314), 2413 


1 4 28 


260 


2844 


34564 


3412 


1 4 29 


290 


3532 


49100 


1324 


1 4 29 


292 


3620 


51866 


(1342,3124) 


1 5 42 


453 


5651 


77498 


(2431,4213) 


1 5 42 


454 


5680 


78129 


4231 


1 5 42 


462 


6070 


90686 


4321 


1 5 61 


744 


10329 


157586 



Table 2: Values of An{p) for even n and p G 6*4. Parentheses indicate trivial 
equivalences. 



Tables |3] and S] give the number of alternating permutations avoiding 
certain patterns of length five. Only those patterns that might potentially 
have nontrivial equivalences are included, and they are grouped by these 
potential equivalences. 



Patterns 


13 5 7 9 11 


(12534,43521), (21534,43512) 


1 2 16 243 5291 144430 


(12453,35421), (21453,35412) 


1 2 16 243 5307 146013 


(12354, 45321), (12543, 34521), 
(15432, 23451), (21354, 45312), 
(21543, 34512), (32154, 45123) 


1 2 16 243 5330 148575 


(12435,53421), (21435,53412) 


1 2 16 243 5330 148764 


(12345, 54321), (21345, 54312), 
(32145, 54123), (43215, 51234) 


1 2 16 272 6531 194062 



Table 3: Selected values of An{p) for odd n and p E S5. Parentheses indi- 
cate trivial equivalences. All possible nontrivial equivalences are among the 
permutations in this table. 



Patterns 


2 4 6 8 10 12 


(12534,23145), (21534,23154) 


1 5 56 997 23653 679810 


(34512,45123), 45312 


1 5 56 1004 24310 724379 


(12435,13245), (13254,21435) 


1 5 56 1004 24336 727807 


(12453,31245), (21453,31254) 


1 5 61 1194 30802 953088 


12345, 21354, (12354,21345), 
(12543,32145), (15432,43215), 
(21543,32154), (23451,51234), 
(34521,54123), (45321,54312) 


1 5 61 1194 30945 970717 



Table 4: Selected values of An{p) for even n and p E S^. Parentheses indi- 
cate trivial equivalences. All possible nontrivial equivalences are among the 
permutations in this table. 
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Table gives the number of permutations of length 3n with descent set 
{3, 6, . . .} that avoid certain patterns of length four and five. Only those 
patterns that might potentially have nontrivial equivalences are included. 



Patterns 


3 6 9 12 


2413, (1423,2314) 


1 9 153 3465 


(1243,2134), (2341,4123) 


1 9 153 3579 


3142, (3241,4132) 


1 19 642 27453 


2143,4231, (1432,3214), (3421,4312) 


1 19 642 29777 


(12354, 21345), (23451, 51234) 


1 19 887 66816 


(15243, 32415), (35241, 52413) 


1 19 1077 102051 


(12543, 32154), (34521, 54123) 


1 19 1134 114621 


21354, 52341 


1 19 1134 115515 


(15432, 43215), (21543, 32154), (25431, 53214), 
(31542, 42153), (32541, 52143), (35421, 54213), 
(41532, 43152), (42531, 53142), (43251, 51432), 
(43521, 54132), (45321, 54312), (52431, 53241), 
(53421, 54231) 


1 19 1513 211425 



Table 5: Selected values of Des„,3(p) for n divisible by 3 and p G S4 or S5. 
Parentheses indicate trivial equivalences. All possible nontrivial equivalences 
are among the permutations in this table. 
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